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1.  Introduction 

There  is  a  current  need  for  a  robust  multivariable  flight  control  design  technique 
which  gives  good  performance  under  changing  environment,  disturbances,  and  uncertainty 
in  modehng.  Also,  it  is  very  useful  to  know  the  maximum  possible  performance  under 
worst  case  conditions.  Design  techniques  based  on  Hoo  methods  are  ideally  suited  for 
yielding  good  performance  of  the  aircraft  even  under  worst  case  conditions.  Thus,  at  the 
Naval  Air  Development  Center,  efforts  are  underway  to  demonstrate  the  feasibility  and 
advantages  of  flight  control  design  techniques  based  on  finite  horizon  Hoo  techniques. 

The  Hoo  optimal  control  problem  has  received  considerable  attention  recently  and  it 
is  well-known  that  Hoo  suboptimal  controllers  can  be  synthesized  via  the  solution  of  two 
algebraic  Riccati  equations  under  certain  restrictive  assumptions[l].  These  assumptions 
can  be  removed  using  various  transformations[2],  and  thus  controller  synthesis  can  be 
accomplished  in  the  general  case  in  an  indirect  manner.  Recently  the  techniques  have 
been  extended  to  time-varying  systems[3]  under  similar  restrictive  assumptions.  One  of 
the  contributions  of  the  present  report  is  the  derivation  of  the  results  in  a  general  cas^^  in 
the  time-varying  setting.  The  synthesis  of  the  controller  is  accomplished  for  a  general  error 
criterion  in  the  finite  horizon  case  and  the  implementation  of  the  equations  on  a  digital 
computer  is  ea.sy.  The  synthesis  can  be  accomplished  by  means  of  two  dynaiuic  Riccati 
equations,  one  related  to  the  controller  part  and  the  other  to  the  observer  part.  In  the 
time-invariant  case,  the  solutions  of  these  equations  usually  tend  to  constant  matrices. 

A  lot  of  current  research  has  also  been  directed  towards  the  problem  of  estimating 
the  infimal  Hoc  norm  of  a  given  system.  There  are  a  few  iterative  techniques  in  the  time- 
invariant  case.  There  are  virtually  no  techniques  in  the  time-varj’ing  case  and  another 
contribution  of  this  report  is  an  efficient  technique  for  the  estimation  of  the  infimal  Hoo 
norm  in  a  very  general  setting.  The  technique  consists  of  considering  the  inherent  minimax 
problem  and  treating  the  adjoint  variables  associated  with  the  maximization  problem  as 
state  variables  for  the  minimization  problem.  Once  this  is  accomplished,  the  techniques  of 
[4-9]  can  be  applied  to  get  the  infimal  norm. 

We  treat  the  problem  of  existence  and  computation  of  the  minimal  Hoc  norm  initially. 
Then  the  problem  of  synthesizing  the  suboptimal  Hoo  controllers  will  be  taken  up.  In  the 
derivation  of  the  output  feedback  controller,  the  full  state  feedback  expressions  are  useful 
in  the  definition  of  the  gain  of  the  controller  pau-t  and  duality  plays  an  important  role  in 
the  assignment  of  the  gain  of  the  observer. 

In  all  control  problems  it  is  very  useful  to  know  the  maximum  possible  performance 
under  worst  case  conditions.  The  theory  of  Sections  2-6  is  useful  in  obtaining  a  quantitative 
idea  of  achievable  performance.  Since  suboptimal  design  is  more  practical,  this  topic  will 
be  treated  in  Sections  7-10.  Also  the  command  following  problem  can  be  suitably  recast 
to  fit  the  problem  formulation  of  Section  7. 

In  the  time-invariant  case,  the  solutions  of  the  dynamic  Riccati  equations  involved 
usually  tend  towards  constant  matrices,  if  the  final  time  is  large  enough.  This  is  very 
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valuable  in  the  case  of  flight  control  design.  Research  is  also  being  done  to  successfulh 
deal  with  parameter  veiriations  under  the  present  setting.  In  our  reserach  we  are  mainly 
interested  in  the  robust  performance  aspects  of  the  aircraft  under  variations  of  the  system 
model,  as  opposed  to  robust  stability  considerations. 

2.  Existence  of  Optimal  Inputs 

In  this  section  we  obtain  results  for  the  existence  of  optimal  exogenous  and  control 
inputs  for  the  finite  horizon  Hoc  problem.  Consider  the  system  given  by 

X  =  A{t)x  +  Bi{t)u  -r- B2{t)tu  l(0)  =  0.  V- 

z  =  Cit)x  +  D{t)u  +  E{t)v,  (2.2) 


where  x  and  z  are  the  state  vector  and  the  error  vector  respectively.  The  matrices 
A{t),  Bi{t),  B2{t),C{t),  D{t),  and  E{t)  will  be  assumed  to  be  continuous  on  [0,T],  where 
T  is  the  final  time.  In  addition  u,t’  G  L2{Q,T). 

The  problem  is  to  show  the  existence  of  u  and  i>  for  which 


inf  sup 

i'#0  ti 


//  \v*Rvdt 


(2.3) 


is  achieved.  In  (2.3)  R{t)  and  W{t)  are  continuous  positive  definite  matrices  on  [0,r]. 

We  now  consider  the  maximization  part  in  (2.3).  We  will  show  that  given  any  v, 
there  exists  a  u  which  minimizes  :*Wzdt.  By  simple  changes  in  v'ariables,  the  above 
minimization  problem  can  be  converted  to  a  problem  of  the  form  considered  in  Example 
2,  Section  3.3  of  [10].  From  the  results  of  [10],  there  exists  a  unique  u  which  minimizes 
A. 

We  can  write  the  functional  in  (2.3)  as 


J(u, v)  = 


_ /o^  lv*it)Rit)v{t)  dt _ 

lo  +  2:*IF2W  +  +  x*Wav  4-  -t-  li'Wgv}  dt 


We  will  use  the  adjoint  variables  associated  with  the  maximization  part  of  (2.3)  as  state 
variables  for  the  minimization  part  of  (2.3). 

Let 

A  =  inf  sup  J(u,r).  (2.5) 

Since  we  established  the  existence  of  a  maximizing  u  for  any  given  ^  0,  it  only  remains 
to  establish  the  existence  of  a  minimizing  v  to  guarantee  the  existence  of  A. 
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Let  6  be  the  adjoint  variable  associated  with  the  maximization  problem.  For  any 
V  ^  0,  we  need  to  select  u  to  minimize 

{  +  -u’H  3U  +  x*\\\v  4-  +  u'Hev}  dt  (2.6) 

From  the  maximum  principle[10],  which  in  this  case  is  also  a  sufficient  condition  for  opti¬ 
mality  because  of  the  imiqueness  of  the  optimal  u,  the  Hamiltonian  is  given  by 

H  =  — {-a-'IFj  -f-  x*W2U  -I-  -u*W3U  +  x*W4V  -|-  -u’Hsu  +  + 

+  Bi{t)u  +  B2(r)r}.  (2.7) 

The  adjoint  variable  6  satisfies 

^  =  H'l  X  +  U  2ii  +  U 4r  -  A* 6,  (2.8) 

wirii 

x(0)  =  0,  ^(r)  =  0.  (2.9) 

Assuming  that  1^3  is  invertible  for  all  t  €  [0,T],  the  optimal  controller  is  given  by 


u  =  Tr3-^(H*^-Tr;x-H6r). 


(2.10) 


A  =  A- 

b  =  ba\7^b;, 

c  =  ir,  -  W2Wf^w7 

Gi  =B2-b^\\7H\7 
G2  =  W4  -  H  2H7MF6. 

Thus  we  have 


x(0)  =  0,  ^(r)  =  0. 


(2.11) 

(2.12) 

(2.13) 


3 


NADC-9 1077-60 


Let 


U,  =  lVi^(-W,*  Br, 

U,  =  -W^HVe, 

and 

0„). 

We  define  the  matrices  Qi,Q2^  and  by 

Qi  =  v:w,u„  +  irww,  +  UlW^Un  +  v:w,u,, 
Q2  =  K\V2U,  +  u:\v,u,  +  irWi  +  U:We. 

Q,  =  u:w3Ur  +  fts  +  2t/;ir6. 

The  system  given  by  (2.12)  can  be  written  as 

C  =  M(t)C  +  A(0t’, 

with 

x(0)  =  0,  ^(T)  =  0, 

and  V  needs  to  be  selected  to  minimize  the  cost 

_ ^^v*it)R(t)rit)dt _ 

Ij' {-2C{t)QiitK{t)  +  CQ2V  +  ^v^Qsv}  dt  ■ 


(2.14) 


(2.15) 

(2.16) 

(2.17) 

(2.18) 

(2.19) 


(2.20) 

(2.21) 

(2.22) 


(2.2o) 

(2.24) 


(2.25) 


We  now  investigate  the  conditions  under  which  a  minimizing  n  exists.  Note  that  if 
t’  =  0,  the  denominator  of  (2.25)  is  zero  and  that  the  minimum  \'a]ue  of  (2.25)  over  n  0 
is  A. 

Theorem  2.1.  Consider  the  system  given  by  (2.23)  and  (2.24).  Assume  that  there  exists 
a  V  e  L2(0,T)  for  which  0  <  JqI^CQiC  +  CQ2^'  +  ^v*Q3v}dt  <  co.  Let 


X  =  inf 


(2.2G) 
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Also  assume  that  R{i)  —  XQ3{t)  >  a  >  0  for  all  t  G  [0,  T]  and  ^  ^  positive 

semidehnite.  Then  there  exists  vq  G  £2(0,  T)  which  minimizes  (2.25).  Also,  the  minimum 
value  of  (2.25)  is  strictly  positive. 

Proof.  Since  (2.25)  is  invariant  under  scaling  of  r,  it  suffices  to  consider  only  those  r 
for  which  /o^{|C*QiC  +  CQ2V  +  |e*Q3i'}  dt  =  1.  Let  {r?,}  be  a  sequence  in  £2(0.  T)  such 

that  lim,— oc  \v*Rv^dt  =  A  with  Jq  {^QQiCt  +  CQ2V,  +  ^v*Q3V,}dt  =  1  for  each  i. 

Here  (,  is  the  response  of 

C.  =  M(0C.  +  (2.27) 

with 

x,(0)  =  0.  0,(7’)  =  0.  (2.28) 

Since  {r,}  is  bounded  in  £2(0^7’),  a  subsequence,  still  denoted  by  (r,)  converges 

weakly  to  some  ro  G  £2(0,  T).  Also  we  can  select  the  subsequence  such  that  {(,(0)}. 
T  T 

{/o  {/o  i^''(^udt}  are  convergent.  Let  C,(0)  — >  C°.  We  have 

C.(O  =  C.(0)+/  Mt.T)Mr)v,{T)dT,  (2.29) 

Jo 

where  ^{t,r)  is  the  transition  matrix  of  (2.27).  Let  Co(0  satisfy 

Co  —  Ai  (t  +  A  (d;t  o,  Co(0)  =  (2.30) 


It  is  clear  that  by  the  weak  convergence  of  {v,},  C«(0  converges  pointwise  to  Co(0-  From 
(2.29).  it  follows  that  for  sufficiently  large  ?,  the  responses  ((Jt)  are  uniformly  bounded. 
Ey  tlie  Lebesgue  dominated  convergence  theorem,  we  conclude  that 

f  CitiQiinoitidt I  Co(ogi(t)Co(nd/.  (2.31) 

Jo  Jo 


Also  we  have 
-T 


f  CtQ2^'tdt—  f  CoQ2^'odt—  [  (C<  —  Co  )*Q2ei  df  +  f  QQ2[i\  —  vq)  dt.  (2.32) 
do  Jo  Jo  Jo 

It  can  be  easily  shown  that  the  right  side  of  (2.32)  goes  to  zero  as  i  — >  cc.  Thus 

rT  rT 


lim  /  C.*Q2J’,  d/=  [  CoQ2t’o  df. 
Jo  Jo 


[2.33) 
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Note  that 


f  {U:qi0 + c<?2t’.  +  \v:Qiv,}dt  =  iVi,  (2.34) 

Jo  ^  ^ 

T'  T'  T* 

/  {«Co^iCo  +  Co^2i^o  +  r^’o^3i^o}  =  1— lim  /  j  -rlQ^v^dt.  (2.35) 

Jo  ^  2  t— oo  Jo  2  Jo  2 

T 

We  already  noted  that  lini,_»oo  /<)  dt  exists.  As  a  consequence  of  weak  convergence 

r  1  r  1 

/  o^o<?3?’odt  <  hm  /  -v*QiV\dt.  (2.3G) 

Jo  «— >oo  Jo  2 


(2.3G) 


We  claim  that  the  right  side  of  (2.35)  is  strictly  positive.  Otherwise  by  the  positive 
semidefiniteness  of  ^  and  by  (2.34),  (2.35)  and  (2.36),  it  follows  that  tq  =  0  and 

lim,_oo  /o^  dt  =  1.  From  the  assumption  that  R  —  XQ^  >  o  >  0,  we  have 


(2.37) 


Integrating  h  r’,  ddes  from  0  to  J  and  letting  i  go  to  oc,  we  get  A  >  A  +  where  3  >  0. 
This  contradiction  show.s  ti..ai 


/■  •'  1  .  1 
/  1  .so^isu  +  CoQ2^’o  + -CoQsi’o)  d/  >  0. 


Jo  2 


(2.3S) 


We  now  show  that 


_ !l  ^ 

/o  {  2‘'0^l^*0 

T 

Since  lim,^oc  /q  dt  =  A,  we  only  need  to  show  that 

H„.  r  Ir-Rr.  „  -  - _ 

2  /o  {k;«iCo  + «<?!<’.  + i.; 


(2.39) 


Q.ic,}  dt 


(2.40) 


Indeed  the  numerator  of 


/"'l 

/  o^r^i^'idt- 
Jo  2 


lo  2*oQit’o  dt 


1  -  !im,„^  J^‘  dt  +  jCoQ^ro  dt 


(2.41) 
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is  given  by 

T  r 

-  f  \v^{R  -  XQ^Hodt.  (2.42) 

2  Jo  2 

Since  R  —  XQj  >  0,  as  a  consequence  of  the  weak  convergence  of  {r, }  to  J  u-  the  above 
quantity  is  nonnegative. 

Also  A  needs  to  be  greater  than  zero.  Otherwise  =  0.  which  implies  that  the 
corresponding  unique  optimal  a  =  0.  Tliis  makes  the  response*  Co(0  =  0.  and  hence  the 
denominator  of  (2.25)  is  zero,  contradicting  (2. 38).  □ 

3.  INFIM>L  Norm 

In  the  previous  section,  the  minimax  problem  was  converted  into  a  minimization 
problem.  The  resulting  system  was 


C  =  M(tK  +  *V(Or 


(3.1) 


with 

x(0)  =  Q.  ^(r)  =  0. 

where  r  needs  to  })e  selected  to  minimize  the  cost 


(3.: 


ir*(/)/?(/)r(t)d/ 


/o  {|c*(nQi(()C(o  +  C’(0Q2{0'-(n  +  ir*(0Q,^(0f(0}f^/ 


(3.3) 


We  now  state  the  conditions  that  are  .satisfied  by  an  optimal  r{f). 


Tn F.OH  EM  3.1.  Consider  the  system  given  by  (3.1  )-(3.3).  Assume  that  R-  XQ  i  is  invertible 
for  hII  t  £  [0.  T] .  If  !•{)(  t )  minimizes  (3.3).  then  there  exists  a  nonzero  p(  / )  =  (  p*  ( t )  5*  ( t )  )* 

such  that 


clp 

dt 


-M* p  -  AQiC  -  XQiV, 


(3.4) 


where  pit}  and  q(t)  are  components  of  the  adjoint  vector  corresjwnding  to  jr{t)  and  0{t) 
respectively,  such  that 


where 


and 


x(0)  =  0,  e(T)  =  0, 

p{T)  -  0,  <7(0)  =  0, 

(3.5) 

A=„.f  ,  .  , 

{iC*g.C  +  C*Q2^+|r-g3r}dt 

(3.C) 

vo(t)  =  {R  -  xchr'ixQ'.Q-b  y*p]. 

(3.7) 
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Proof.  If  ro(0  minimizes  (3.3).  then  it  also  minimizes 


Ar}  =  J  y-Rvdt-Xf  {\CQ,‘:  +  CQ2V+^^V-Q,v]dl. 

The  theorem  now  follows  from  the  majrimum  principle!  10].  □ 

Let 

M  =  M  +  \N{R-\Q3r^Q;, 

y  =  y(R-  xQ3r'^y\ 

and 

L  =  -XQi  -  X‘^Q2{R-  XQ^r^Ql 


The  variables  satisfy  a  two  point  boundary  value  problem  given  by 


(3.S) 

(3.9) 

(3.10) 

(3.11) 

(3.12) 


with 

a-(O)  =  0,  0(7)  =  0. 

(3.13) 

p{T]  =  0.  qiO)  =  0. 

We  now  give  a  criterion  for  the  estimation  of  A.  Notice  that  A  =  min,.^o  niax^  J(u,?') 
and  gives  a  measure  of  {performance  of  the  optimal  controller  under  worst-case  conditions 
corresponding  to  vo{t).  In  the  Hoo  ease,  the  evaluation  of  A  would  entail  the  ')-iteration. 

TheORE.VI  3.2.  Let  X  he  the  smallest  positive  value  for  v.-hich  the  boundary  value  problem 
given  by  (3.12)  and  (3.13)  has  a  solution  ((,p)  with  {\CQiC  + CQ2^' +  ^V’QiX']  dt  >  0, 

where  v  =  (R  —  XQ3)~^  p}-  Then  X  is  the  minimum  value  of  (3.12),  ((.  p)  is  an 

optimal  pair  and  v  —  (R  -  XQ3)~^  {XQK  +  A’*p}  is  the  worst  exogenous  input. 

Proof.  It  is  clear  from  Theorem  3.1  that  if  I'oii)  minimizes  (3.3),  then  it  satisfies  (3.12) 
and  (3.13).  with  A  being  the  minimum  value  of  (3.3).  Now  suppose  ((.p)  satisfies  (3.12) 
and  (3.13)  for  some  A.  Let  r  =  (i?  -  AQ3 )“' {AQ2C  +  -A’^*p}-  In  the  following  equations  (  ,  ) 
denotes  an  inner  {product. 

We  have 


/  {{R  -  XQ3)v,v)  dt  =  f  (XQlC^,v)dt  +  f  iN*p.v)dt. 
Jo  Jo  Jo 

By  equation  (3.1).  the  second  integral  of  (3.14)  can  be  written  as 

I  (X*p,x')df  =  I  {p,yv)dt~  I  {p.(-M(()dt. 

Jo  Jo  Jo 


(3.14; 


(3.15) 
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An  integration  by  parts  and  equations  (3.4)  eind  (3.5)  yield 


I 


T 

{p,C-MOdt  = 


T  T 

a/  (QiCOdi  +  xf  {(:,Q2v)dt. 

Jo  Jo 


Substituting  (3.16)  in  (3.14),  we  get 


i: 


v*Rv  dt 


A  r{CQl<:  +  ‘^CQ2V  +  V*Q3v}dt. 
Jo 


(3.16) 


(3.17) 


Thus,  the  cost  associated  with  v  is  A.  Hence,  if  ((,p)  is  a  nontrivial  solution  of  the  bound¬ 
ary'  value  problem  given  by  (3.12)  and  (3.13)  for  the  smallest  parameter  A  >  0  with 

/cr{2^*^iC  +  C*Q2t’d-  dt  >  0,  then  A  is  the  optimal  value  and  (C.p)  is  an  optimal 

pair.  □ 

Note  that  the  boundary  \*alue  problem  (3.12)'(3.13)  has  a  solution  with  a  nonvanishing 
denominator  for  (2.4)  for  at  most  a  countably  infinite  %’alues  of  A.  Theorem  3.2  gives  a 
sufRciciit  condition  for  an  exogenous  input  to  be  optimal.  Equations  (3.12)-(3.13)  and 
Theorem  3.2  completely  characterize  the  worst  exogenous  input. 

The  criterion  in  Theorem  3.2  can  be  used  to  devise  computational  tools  for  the  eval¬ 
uation  of  the  infimal  H^c  norm  in  the  finite  horizon  case.  Our  computational  experience 
shows  that  for  time-invariant  problems,  the  infimal  Hoc  norm  in  the  finite  horizon  case 
approaches  that  in  the  infinite  horizon  case  as  the  final  time  T  becomes  large. 


4.  Computation  of  A 

Making  use  of  the  transition  matrix,  the  solution  of  (3.12)  can  be  expressed  as 


/^(0\ 

Oit) 

p(0 

\q{t)  J 


/rill(f,0)  (f>l2{U0)  0i3{t,O}  ril4(ri0)\ 

I  02l(riO)  <p22it,0)  <?23(ri0)  <;i'24(ri0)  j 

1  <^>31(^0)  <;;!>32(ri0)  ^>33(^0)  <?34(fi0)  I 

\<?4l(t,0)  <p42(ri0)  <^>43(^0)  (?44ft,0)/ 


/^(0)\ 

^(0) 

p(0) 

Vg(0)/ 


The  boundary  conditions  given  by  (3.13)  yield 


f<l>22iT,0)  4>23iT.0)\  [  x{0)\  ^ 

V<^32(t.0)  O33(r,o);  V^(0); 


(4.1) 


(4.2) 


Let 


I  022  <?23 
\  4>32  033 


(4.3) 


In  view  of  (4.2)  and  (3.12)-(3.13).  we  have  det((?(r,  0))  =  0  if  and  only  if  the  solution  (C-P) 
of  (3.12)-(3.13)  is  not  identically  zero.  Thus,  we  need  the  least  positive  A  which  makes 
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det(c!)(r,  0))  =  0  and  the  denominator  of  (2.4)  positive.  This  can  be  obtained  by  doing  a 
search  with  A  over  an  interval  on  which  there  is  a  change  in  the  sign  of  the  determinant. 

We  found  the  following  algorithm  to  be  numerically  more  stable  since  numbers  of 
lesser  magnitude  are  involved  in  the  computation  of  the  transition  matrices  in  (4.4).  We 
have 


(4.4) 


Let 


(in 

62 

63 

^4  \ 

^21 

^22 

^23 

^24  I 

61 

^32 

^33 

64 

Ve41 

^42 

^43 

64/ 

(4.5) 


and 


Making  use  of  a'(O)  =  ^(0)  =  6{T) 


/^U 

1'12 

l'i3 

1^14 

V2\ 

1/22 

^'23 

1/24 

^32 

1/33 

1^34 

\  1/41 

1/42 

t'43 

1^44 

(T)  = 

0,  we 

have 

(4.G) 


/6i  Ui\ 

^21  ^24  W3-(T)\ 

6i  64  ^9(2^)/ 

\^41  ^44/ 


/ 1/12  I'lsX 
t/22  *^23  I  /  ^(0)  \ 

1'32  1^33  I  \P(0)  )  ■ 

\  1/42  1^43  / 


(4.7) 


The  above  equation  has  a  nontrivial  solution  if  and  only  if 


det 


/6l 

^14 

V12 

t^l3 

C2I 

64 

U22 

1^23 

61 

^34 

t^32 

*^33 

\^41 

^44 

1/42 

1^43 

=  0. 


(4.S) 


Thus,  we  need  the  least  positive  A  which  makes  the  above  determinant  zero. 


5.  A  Differential  Equation  for  A 

Foi  simplicity  we  derive  a  differential  equation  for  A  only  in  the  case  where  = 
If's  =  Ue  =  0.  Note  that  this  makes  Q2  —  Q3  —  0-  Thus  equations  (3.12)  and  (3.13)  can 
be  written  as 

(0.1  ) 


10 


NADC-91077-60 


with 


x(0)  =  0,^(r)  =  0, 

p(r)  =  0,^(0)  =  0. 


(5.2) 


Now  assume  that  the  final  time  is  changed  to  T  +  AT  where  AT  is  an  elemental 
increment.  The  solution  of  the  above  boundary  value  problem  can  be  extended  to  [0,T  + 
AT].  Suppose  and  pi  2u-e  the  elemental  variations  in  (C,  p)  owing  to  the  increment  AT 
in  T.  That  is,  (C  +  CiiP  +  Pi)  is  the  new  optimal  pair.  Also  denote  the  variation  in  A  by 
A  A.  We  have 

Cl  =  A/Ci  +  iViZ-'iVVi  .53 

Pi=-AQiCi-A/’pi-AAQ,C 


with 

2-j(0)  =  0,^i(T  +  AT)  =  -e{T  +  AT), 

Pi(T  +  AT)  =  —p{T  +  AT),5i(0)  =  0. 

Theorem  5.1.  As  a  function  ofT,  A  satisfies 
dX  -AC*(T)g,(T)C(T)  -  2C(T)Ar(T)p(T)  -  p’(T).V(T)i?-’(T)A'*(T)/>(T) 


(5.4) 


dT 


loCQiCdt 


(5.5) 


Proof:  From  (5.3), 
•r+AT 


/  C*P1  dt  =  -  {XCQiCi  +  C*A/*P1  +  AAC*Q,C}  df. 

Jo  Jo 


(6.6) 


By  an  integration  by  parts, 
.T+AT 


^T'+AT' 

/  C*Pic^^  =  CVi(T  +  AT)-  /  {CM*p,+p^NR-^N-pi]dt. 

Jo  Jo 


(5.7) 


From  (5.6)  and  (5.7) 

rT+AT 


/  {XCQiCi+AXCQi<:]dt  =  -Cpi{T  +  AT}+  p*NR-'^N*p^dt.  (5.8) 

Jo  Jo 


From  (5.1),  the  first  integral  on  the  left  side  of  (5.8)  can  be  written  as 

/■T+AT  rT+AT 

/  Ac*g,Ci^^  =  -/  (p  +  A/v)*Ci<^^ 

Jo  Jo 


(5.9) 
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Integrating  the  right  side  of  (5.9)  by  parts,  we  get 
.r+AT 


fT+AT 

/  XC Q iCi  dt -p*(:i{T  + AT)  +  /  p*NR-^N*pdt. 

Jo  Jo 

Substituting  (5.10)  in  (5.8),  we  get 

J^r+AT 

'  CQi<:dt  =  p*{T  +  AT)<:i{T  +  AT)-C{T  +  AT)piiT  +  AT). 
0 

We  have 


(5.10) 


(5.11) 


/>*Ci(r  +  AT)  -  CpiiT  +  AT)  =  p*{T)CAT  +  AT)  -  C{T)Px{T  +  AT)  +  o{AT) 

=  -q*iT)6{T  +  AT)  +  x*{T)p{T  +  AT)  +  o{AT) 

=  -q-(T)9{T)AT  +  x*{T)p{T)AT  ^  o{AT) 

=  -p‘(r)(:(r)Ar  +  c{T)p[T)at  +  o(at)  (5.12) 

From  (5.11)  and  (5.12).  wo  get  (5.5).  □ 


6  Examples 

The  above  theory  is  useful  in  the  computation  of  the  infimal  norm.  This  problem 
is  still  being  researched  actively  in  the  case  of  both  static  and  dynamic  controllers  and  there 
are  a  variety  of  algorithms  in  the  literature.  In  the  examples  given  below,  we  compute  the 
minimum  Hoc  norm  given  by  (2.4)  as  the  final  time  T  varies.  The  programs  were  written 
using  PC-MATLAB  and  the  least  positive  A  which  satisfies  equation  (4.8)  was  found.  The 
infimal  finite-time  norm  7  is  1/v/A. 

Example  1.  We  consider  the  tracking  example  from  [11].  In  this  case 


/-O.l  0  0\  /0\ 

"io  iij-  "'iU' 


B2  = 


/  0.0081  -0.045  -0.045  \ 

Wi  =  I  -0.045  0.25  0.25  ,  W2 

\ -0.045  0.25  0.25  / 


113  =  1 


/  0.009  \ 

W4  =  I  -0.05  ,  W5  =  0.01,  We  =  0,  i?  =  1. 

V-0.05  / 


The  results  are  given  below. 
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TABLE  1:  Results  of  Example  1 

T 

A 

7  =  l/\/A 

5 

17.6023 

0.2384 

10 

16.3113 

0.2476 

15 

15.9S02 

0.2502 

20 

15.7944 

0.2516 

25 

15.7442 

0.2520 

30 

15.7224 

0.2522 

Example  2.  This  example,  taken  from  [12]  has 


with 


A  = 


/-2  1  1  IX 

3  0  0  0 

II 

0  0 

0  ’-1 

,  B2  = 

0 1 

-1  0  -2  -3 

0  0 

1 

\-2  -1  2  -1/ 

Ko  1/ 

\oJ 

1  0-10' 
0  0  0  0 

-10  10 
0  0  0  0- 


^3 


1  0 
0  1 


iz  =  1,  ir,  = 

and  zero  entries  in  TT2, 11*4,  IT5,  and  ll'e-  Table  2  gives  the  numerical  results. 


TABLE  2:  Results  of  Example  2 

T 

A 

II 

c- 

5 

3.8975 

0.5065 

10 

0.9220 

1.0414 

15 

0.7001 

1.1951 

20 

0.6722 

1.2197 

25 

0.6681 

1.2234 

Example  3.  The  last 

example 

is  also  taken  from  [12]. 

In  this 

;  case 

(  ° 

1 

4 

-4  1  X 

(^\ 

-3 

-1 

1 

2  1 

4 

0 

0 

A  = 

0 

1 

-1 

-1  0 

,  B,  = 

0 

0 

,  B2  = 

1 

2 

1 

-1 

0  1 

0 

0 

0 

V-1 

2 

1 

-2  -2/ 

\0 

2/ 

\\) 
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with 


/I 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

Vo 

0 

0 

0 

0/ 

with  the  rest  of  the  matrices  having  zero  entries.  The  results  zu-e  given  in  Table  3. 


TABLE  3:  Results  of  Example  3 

T 

A 

7  =  1/\A 

5 

0.89262204 

1.05843988 

10 

0.87538735 

1.06880842 

15 

0.87477568 

1.06918203 

IS 

0.87476217 

1.06919029 

7.  SuBOPTiMAL  Problem  Formulation 

The  main  contribution  of  the  remaining  portion  of  the  report  is  the  deri%’ation  of 
the  suboptimal  controller  in  the  time-varying  case  for  a  general  performance  index.  We 
consider  a  generalized  finite  horizon  suboptimal  Hoc  problem.  An  expression  for  a  state 
feedback  controller  is  given  in  terms  of  solution  of  a  dynamic  Riccati  equation.  Also  an 
expression  for  a  suboptimal  output  feedback  controller  is  developed  in  terms  of  solutions 
of  two  dynamic  Riccati  equations.  Throughout  the  report  an  objective  has  been  to  derive 
results  in  as  general  a  case  as  feasible.  The  formulae  for  the  synthesis  of  the  suboptimal 
Hoc  controller  are  summarized  in  Section  5  and  these  can  be  programmed  easily  on  a 
digital  computer  to  synthesize  a  suboptimal  controller.  In  the  time  inrariant  case,  if 
the  final  time  is  sufficiently  large,  the  solutions  of  the  dynamic  Riccati  equations  converge 
to  the  solutions  of  the  correspondirig  algebraic  Riccati  equations. 

Let  the  n-dimensional  time- varying  system  be  given  by 


X  =  A{i)x  +  Bi{t)u  +  B2{t)v,  x(to)  =  0, 
z  =  C{t)x  +  D{t)u  -f  E{t)v, 
y  =  C2{t)x  +  D2{t)u  +  E2{t)v. 


Without  loss  of  generality,  let  to  =  0.  Also  let 


'opt 


=  max  min 

u 


\z*Wzdt 


(7.1) 

(7.2) 

(7.3) 


(7.4) 


where  R  emd  W  are  assumed  to  be  positive  definite  and  the  superscript  *  denotes  a  matrix 
or  vector  transpose.  Computational  techniques  for  the  ev'aluation  of  Xgpt  are  given  in 
Section  4.  The  problems  addressed  in  the  report  can  be  stated  as  follows. 
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Problem  1.  Given  A  <  Xgpt,  find  a  full  state  feedback  controller,  if  it  exists,  for  which 

mm  - >  A. 

Xz-Wzdt 

Problem  2.  Given  A  <  Xopt,  find  an  output  feedback  controller,  if  it  exists,  for  which 

Jo  ^ 

iniri  rp  ^  A. 

/o  \z*Wzdt 

8.  Full  State  Feedback  Problem 

Consider  the  performance  criterion 


T  T 

/  -v*Rvdt-xf  l-z*Wzdt. 
Jo  2  Jo  2 


We  will  first  find  a  saddle  point  with  respect  to  the  criterion  (8.1).  The  motiration 

for  finding  the  saddle  point  is  so  that  we  can  construct  a  suboptimal  H^c  controller  on  the 
finite  inter\'al  [0,  T]. 

The  functional  (8.1)  can  be  written  as 

T  T 

J(u,v)=  f  lv*Rvdt-x[  +  +  JunPau 

Jo  2  Jo  2  2 

+x*WiV  +  lv*W5V  +  unVev)  dt.  (8.2) 

Given  u(t),  let  maximize  (8.2).  The  following  lemma  characterizes  f°(t). 

Lemma  8.1.  Let  X  be  such  that  R  —  AH's  is  positive  definite  for  ail  t  G  [0,T].  For  a  given 
u,  if  v^(t)  minimizes  (8.2),  then  tlere  exists  a  nonzero  rj(t)  such  that 

^  =  -A*tj  -  XWix  -  XW2U  -  XWy,  t]{T)  =  0,  (8.3) 


v°{t)  =  (i?  -  AWs)"'  +  XW^x  +  AH^n.}  (8.4) 

Proof.  By  the  maximum  principleflO],  there  exists  2m  adjoint  response  r]{t}  such  that 
the  Heimiltonian 

H  =  X{]-x*Wix  +  x*W2U  +\u*W:iU  -b  x*WiV  -b-v*W^v  -b  u^W^v] 

2  2  2 

-\^v*Rv  4-  r}*{A{t)x  +  Bi{t)u  +  B2{t)v.].  (8.5) 
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is  maximized  almobi  everywhere  on  [0,T].  Satisfaction  of  ^  =  0  yields  (8.4).  The  adjoint 
variable  r]  satisfies 

^  =  -A*t]  -  XWix  -  XW.u  -  XW^v^.  (8.6) 

dt  ux 

By  the  transversality  condition,  r}[T)  =  0.  □ 

In  a  similar  manner,  we  can  get  an  expression  for  an  optimal  u°(t)  which  maximizes 
(8.2)  for  given  v  and  A. 

Lemma  8.2.  Consider  the  system  given  by  (7.1).  Assume  that  W3  is  positive  definite  for 
all  t  £  [0,T].  For  a  given  v,  ifu^(i)  maximizes  (8.2),  then  there  exists  a  nonzero  t/’(0  such 
that 

^  =  -A*xI^  +  \V,x  +  W2U° +  W^v,  iiT)  =  0,  (8.7) 


u\t)  =  -  W*x  -  Her).  (8.8) 

Proof.  Proof  is  similar  to  that  of  Lemma  8.1.  □ 

Simultaneous  solution  of  (8.3),  (8.4),  (8.7),  and  (8.8)  yields  a  saddle  point  solution 
(u°,i'°)  for  the  functional  given  by  (8.2).  We  now  express  the  above  minimax  solution  in 
a  simpler  form. 

From  (8.3)  and  (8.7),  at  a  saddle  point  solution  (ti°,t’°),  we  get 


-{Xv  +  11)  =  -A’(t)(Av>  +  T7),  XiliT)  +  ri{T)  =  0. 

It  follows  that 

Ai/’(t)  4- r?(t)  =  0,  te[o,r]. 

Thus  the  saddle  point  solution  is  characterized  by 

A*.L  1  TI7  _  1  TI’’  I  Tjr  0 


(8.10) 


-f  W,x  +  +  W,v\  (8.11) 

dt 

«“(()  =  W,-'  {B;vi  -  -  H';''").  (8-12) 

=  \(R  -  +  H'/i  +  W'j-u').  (8.13) 

We  define  the  full  state,  feedback  controller  the  following  way.  Assuming  that  the 
inverse  of  W3  +  ATT6(-R  —  AI4  5)“Hig*  exists,  let 

n  =  {R-XW3)-\  (8.14) 

A=  {W3  +  AW6mP6*}-^  (8.15) 

t/j  =  A(B*  +  AWefiB*),  (8.16) 

U2  =  -A{W;  +  AWefiWV),  (8.17) 

Vi  =  xni-B;  +  w;ut),  (8.::; 

V2  =  xniw: +  w;u2).  (8.19) 


16 


NADC-91077-60 


Substituting  (8.13)  in  (8.12),  we  get 


=  Uilj’  +  U2X- 


Substituting  (8.20)  in  (8.13),  we  get 


=  ViV’  + 


Let  e  be  arbitrary.  On  [c,  T],  let 


ip{t)  =  Pit)x{t). 


On  [e,  r],  we  get 


P  +  PiA  +  BiU2  +  B2I2)  +  {A*  -  W2U1  -  Wi\\)P 

+P(B^  U,  +  B2V,  )P  -  (H'l  +  W2U2  +  W4V2)  =  0,  PiT)  =  0. 

Define  the  feedback  controller  and  the  exogenous  input  by 

uo  =  U\Px  +  U2X, 

Vo  =  ViPx  +  V2X. 

We  now  show  that  the  performance  of  this  feedback  controller  is  greater  than  A. 
Theorem  8.1.  Consider  equations  (8.23)  and  (8.24).  Then  for  this  controller 


iill  - - 

*'^0  /o  ^Z*Wzdt 


(8.20) 


(8.21) 


(8.22) 


(8.23) 


(8.24) 

(8.25) 


(8.26) 


Proof.  An  elementary  calculation  shows  that  in  equation  (8.23),  Bjl/i  +  B2V1  and 
U'l  +  W2U2  +  W4I2  are  symmetric  and 


(A  +  B1U2  +  B2V2)*  =  A*  -  W2U1  -  W4P1. 


(8.27) 


Thus  P  is  symmetric.  Since  (8.20)  and  (8.21)  follow  from  (8.12)  and  (8.13),  we  have 

Uo  =  W-^  {B^Px  -  w;x  -  WeUo},  (8.28) 

Uo  =  \fl{-BlPx  +  W;x  +  W^uo).  (8.29) 

Since  P{T)  =  i(0)  =  0,  we  have 


f  —{T*Px)dt  =  0 

Jo  di' 


(8.30) 
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Since 

X  Ax BiUq B2V  =  (A BiUiP  -h  BiU2)x  A  B2'i\  (8.31) 

where  r?  is  an  arbitrary  function  of  time,  we  get  after  some  algebra 

^(r*Pr)  =  i*Px  +  2r’Pi 

=  x*W\x  +  x*W2Uo  +  x*W4Vq  —  x*PB2Vo  +  x*PB\Uo  +  2x*  P  Biv  .{S.Z2) 
From  (8.28)  and  (8.29),  we  get 


B^Px  —  W^uq  a  \V2^  + 

BlPx  =  +  ^V^x  +  Weuo, 


(8.33) 

(8.34) 


Substituting  (8.33)  and  (8.34)  in  (8.32),  we  get 


4-(x*Px)  =  x*lVjx  A  2x*W2Uo  +  u*W3Uo  A  2x*\V4V 
at 


,  r.  .TT-  ,  (v-Vo)*^  Vt’-l’o) 

- - +  2uq\\^v  + - ^ - . 


(8.35) 


f  rom  (8.35)  and  (8.30),  we  get 

rT  rT 


[  v*Rvdt-\  [  z*Wzdt=  [  {v-voyQ~\v-vo)dt. 

Jo  Jo  Jo 


(8.36) 


Note  that  in  the  above  equation  v  is  an  open  loop  function  of  t,  whereas  ro  is  a  feedback 
function  of  x.  Note  also  that  is  positive  definite  on  [0,  T].  Since  the  map  v  v  —  vq 
and  its  inverse  are  bounded,  it  follows  that  there  exists  ^  >  0  such  that 


u-ro)*f^  ^(t'-uo 


v*Rv  dt. 


From  (8.36)  and  (8.37),  we  have  (8.26).  □ 


(8.37) 


9.  Output  Feedback  Controller 

Consider  again  the  system  given  by 

X  =  A(t)x  +  Bi(t)u  +  B2(t)v, 
z  =  C(t)x  +  D(t)u  -f  E(t)v, 
y  —  C2it)x  +  D2{t)u  +  E2{t)v. 
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C  =  C2  +  E2\\P  +  E2\^,  (9.4) 

where  V\  axid  V2  are  defined  by  (8.18)  and  (8.19).  Assume  that  the  controller  is  of  the 
form 

q  =  Aq->r  Bi{L\Pq  +  ^^2?)  +  B2{\\Pq  +  V2q)  +  L{Cq  +  D2U  -  y),  (9.5) 

u  =  UiPq  +  U2q,  (9.C) 

where  the  observer  gain  L  needs  to  be  determined. 

Let 


Uq  =  UiPx  +  U2X, 
I’o  =  Vi  Pa-  +  Via-, 
r  =  u  -  no, 

w  =  V  -  Vo, 
e  =  X  —  q. 


(9.7) 

(9.8) 

(9.9) 

(9.10) 

(9.11) 


Let  the  control  be  given  by  (9.6)  and  let  P  be  the  solution  of  (8.23).  We  have 

X  —  Ax  +  Bi {L' i  P  +  U2)q  +  B2V, 

where  v  is  an  arbitrary  function  of  time. 

LE.MMA  9.1.  For  the  above  system,  we  have 

f  V*  Rv  dt  —  \  f  z*\Vzdt=  f  u*Q~^wdt 
Jo  Jo  Jo 

T  T 

-a  /  r*\\\rdt-2\j  r*\VoU'df. 
Jo  Jo 

Proof.  We  have 


(9.12) 


(9.13) 


a-’Px  +  2x*Pi-  =  x’Vria-  +  x*Vr2no  +x*PPi(2u  —  uo)  +  x*PB2i2v  —  vo).  (9.14) 

From  (8.33)  and  (8.34), 


B*Px  =  IV3U0  +  Wj’x  +  Hisvo, 
B*Px  =  +  WJx  +  VV;*no. 


(9.15) 

(9.16) 
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Incorporating  (9.15)  and  (9.16)  in  (9.14)  and  rearranging,  the  right  side  of  (9.14)  can  be 
written  as 

i*VV'ix  -f  2x*Vr2U  +  a’ll’sK  +  2x*Vr4i’ - - - 1-  2u*Wev 

A 

-{u  -  uoYWiiu  -  Uo)  +  ^ - —  -  2(U  -  uo)*U6(t’  -  ro).  (9.17) 


Since 


fT  d  ■ 

I  —{x“'Px)dt=  I  {x*Px  +  2x*Px}  dt  =  0, 

Jq  Jo 


(9.18) 


the  result  follows.  □ 


We  want  to  ultimately  show  that  the  right  side  of  (9.13)  is  larger  tluui  I  f  r*  Rr  di 


for  some  6  >  0.  It  easily  follows  that  (  ■=  x  —  q  and  r  =  u  —  uq  satisfy 

e  =  ( .4  +  LC)(  +  { Pi  +  LE2  )«'. 
r  =  D( , 


where 


.4  =  .4  +  P2 1 1 P  4"  Ri  1 2 ' 

B  = 


(9.19) 

(9.20) 


(3.21) 

(9.22) . 


Note  that  C  is  defined  by  (9.4)  and  L  is  the  gain  of  the  observer.  The  right  side  of  (9.13) 
can  be  written  as 


where  (.sec  (7.2)) 


f  f 

/  u*Ru'dt-Xl  iprcdt. 

xo  Jo 


z\  =  Dr  +  Eu'  =  DDt  4-  Eu\ 


(9.23) 


(9.241 


We  determine  L  by  considering  the  dual  of  (9.19)  and  (9.24).  Our  ultimate  goal  is  to  show 
that  for  the  L  to  be  vliospn,  the  controller  given  by  (9.5)  and  (9.6)  is  suboptimal. 

Let  r  =  —1.  The  dual  system  can  be  defined  on  [— T,  Oj  as 


—  =  A'i  +  CM  +  P‘Z9M', 

dr 

zi  =  +  E2U  +  f’u’, 

and  the  functional  corresponding  to  (9.23)  is  written  as 


I  1 

J  ^  -tZ-Mr-'redr-A  j  ^-'z\R-^=,  dr. 


(9.25a) 

(9.25ft) 


(9.26) 
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Let  us  write  (9.2G)  as 

/■°  1  Z'®  1  '  -  1  - 

/  -w*]V-U'dT  -  \  {-e’U’if' -h  t'*H  2ii -(- -G'Wsu 

J-T ~  J-T  2  2 

+  -u-^^Vsw  -f-  ii'HeU’}  dr.  (9.27) 

We  now  find  a  saddl»>  point  solution  for  the  functional  in  (9.27).  The  saddle  point  solution 
will  be  useful  in  defining  the  gain  L  of  the  observer. 

This  problem  is  completely  analogous  to  the  full  state  feedback  problem  of  Section  3 
and  we  can  write  the  solution  by  inspection.  Equations  (9.25a)  and  (9.27)  are  analogous 
to  equations  (7.1)  and  (^.2)  rpspectively.  Assume  that  IV3  and  —  Alt's  ^re  positive 
definite  and  3  is  the  adjcunt  variable.  Ob,serving  (S.11)-(S.13).  the  saddle  point  solution  is 
characterized  by 


—j—  —  —  Ad  +  11  if  +  112*7  II4U’,  5(0)  =  0, 

dr 

(9.28) 

i,=:\V,-'{Cd-\V‘e  -Wiir). 

(9.29) 

t?  =  A(ir-'  -  All's )-‘{-£)^.?  +  ir;f  +  ii-;i7}. 

(9.30) 

Assume  that  ll's  +  All', 5(11'“'  —  All’s is  invertible.  The  equations 
(S.14)-(S.19)  are 

analogous  to 

^  =  (ir-'  -  All’s)-'. 

(9.31) 

r  =  {rr3  + Air,$ir;}-‘. 

(9.32) 

5i  =  nc  +  X]\\,^DD). 

(9.33) 

52  =  -r(rr2*  +  Arr6‘frr;). 

(9.34) 

7i  =  X^(-DD  +  W^Si). 

(9.35) 

t2  =  x^(\v:  +  \]-s,). 

(9.3G) 

Substituting  (9.30)  in  (9.29).  we  can  write  u  and  ir  as 

11  =  Sid  S2f  . 

(9.37) 

u'  =  T]  d  +  72f . 

(9.3S) 

Letting 

3  =  Yc 

(9.39) 

on  [  —  7.0].  we  get  the  Riccati  equation 

=  (A-  ir^S,  -  11-471 )}'  +  }'(.4*  +  C*52  +  5*D*72) 

dr 

+y'(C*Si  +  D‘ D*Ti)Y  -  {\Vi  +  112 52  +  11-472).  7(0)  =  0.  (9.40) 
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which  is  analogous  to  (S.23).  It  can  be  easily  verified  that  (9.40)  is  symmetric. 
Define  Uq  and  ti’o  by 


uo  =  SjV'c  +  S2C, 

u’o  =  T\Y  i  +  T^i. 


(9.41) 

(9.42) 


LEMM.4  9.2.  Consider  equations  (9.40)  and  (9.41 )  and  assume  that  at  u  ^  uq,  given  e  >  0 
there  exists  T  >  0  sue!}  that  for  any  w  ^  0  and  all  T  >  T,  li*(  —  T)y(  —  T)i(  —  T)l  < 
(  f°j.  w*U’~^u'  dr.  Then  there  exists  S  >  0  such  that  for  all  T  >  T, 


fO  rQ  ,0 

/  w*W-U'dT-\  z\R-^hdT>8 
J-T  J-T  J-T 


w  dr. 


(9.43) 


Proof.  Following  similar  reasoning  as  in  the  proof  of  Theorem  8.1.  we  can  write  the 
equation  analogous  to  (8.35)  as 


dr 


(c*}  i)  —  e*n  if  +  2e*Tl  4"  3*^0  T  2f*]l4?7’  -j-  u'*H5ir 


-  if'ir  ,  (xc-u'oy^  ^xr-xro, 

+2i/(jU6U' - ^ - + 


A 


A 


(9.44) 


Integrating  both  sides  from  —T  to  0.  we  get 
ro  ,0 

J  a'*  U’  -  ‘  w  dr  -Xj  r^R-^  zi  dr  = 


L 


(a'  -  a'o)*$~Ma'  -  a'o)dr  +  Xc^i-T)Y{-T)t~(-T). 


(9.45) 


r 


Let  e  >  0  be  sufficiently  small.  Since  the  map  ic  — >  xI'-xJ-q  and  its  inverse  are  bounded, 
there  exists  8  >  Q  such  that 


/•O  yO 

J  (ir  —  a’o)*4>  '  (ih  —  a’o)  dr  ^  (e -r  Ae)  J  x7i*W  ^  d  dr. 


(9.46) 


Now  by  the  assumption  on  t*(~T)y{—T)t(—T),  equation  (9.43)  follows,  if  T  >  T.  □ 
We  now  go  back  to  the  original  problem  and  reverse  time  in  (9.40). 

Theorem  9.1.  On  [0. T],  let 

y  =  (A-  rr2S,  -  \\\T )r  +  >'( +  c*52  +  b^d*T2) 

+}'((:'*5i  +  D^D*T0y  -  (U*,  +  14252  +  W4r2),  }'(0)  =  0.  (9.47) 
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L  =  {SiY  +  S2T.  (9.48) 

Consider  (9.12).  Let  T  be  as  deRned  in  Lemma  9.2.  IfT>T,  there  exists  S  >  0  such  that 

>T  fT  rT 


[  v*Rvdt-\f  z*Wzdt>S  [  v*Rv 

Jo  Jo  Jo 


dt. 


(9.49) 


Proof.  From  equation  (9.43)  of  the  dual  system,  we  deduce  that  if  T  >  T, 

f  w* Rw  dt  —  \  /  z\Wzidt>Sx  /  w*Rwdt, 

Jo  Jo  Jo 

for  some  6]  >  0.  Since  the  map  ic  — ►  v  is  bounded,  there  exists  6  >  0  such  that 

•  7’  fT  fT 


(9.50) 


/  w*Rwdt-\j  z\\Vzxdt>l  !  v^Rvdf. 

Jo  Jo  Jo 


(9.51) 


From  (9.13),  (9.23),  (9.24),  and  (9.51),  we  get  (9.49).  □ 

The  above  theorem  shows  that  for  the  controller  defined  by  (9.5)  and  (9.G).  the  per¬ 
formance  is  greater  than  A.  In  fact  from  equation  (9.49),  we  have 


inf  >  A. 


(9.52) 


10.  Summary  of  Results 

The  system  is  given  by 


a  =  A{t)x  -i-  Biit)u  +  B2(t)v,  a-(O)  =  0, 

(10.1) 

2  =  C{t)x  -f  D(t)u  +  E{t)v, 

(10.2) 

y  =  C2{t)x  -t-  D2{t)u  -!-  E2(t)v. 

(10.3) 

\  ■  Jo 

Aovt  =  max  mm  --v  - - , 

(10.4) 

and  let  A  <  Xopt-  Also,  let  IFi ,  ■  •  ■  ,  IFe  be  defined  by 

z*Wz  =  x*Wix  +  2.t*\V2U  +  u’U'su  +  2x*WiV  +  ^*145?'  -t-  2u*U6r.  (10.5) 
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The  relevant  controller  equations  are 


fi  =  (i?-AH5)-\ 

(10.6) 

A={H^3  +  AH^6mV6}"', 

(10.7) 

Ux  =  A{B\  +  AH6fiB2), 

(10.8) 

U2  =  -A(1T2*  +  AHef^HV), 

(10.9) 

Vx=Xil{-Bl  +  W;L\), 

(10.10) 

V2  =  Af2(H7  +  H^IN), 

(10.11) 

P  +  P{A  +  Bi U2  +  B2V2)  +  (A*  -  W2U,  -  \\\\\ )P 
+P{B,lh  +  B2\\)P  -  (ITi  +  W2U2  +  11412)  =  0,  P{T)  =  0.  (10.12) 


Note  that  the  above  equation  is  symmetric. 

Let 

zi  =  B^i  +  E2U  +  E*u-, 
and  let  Vl'i ,  ■  •  • ,  He  be  defined  by 

z;R-^zi  =  e*H*ie  +  2e*H2U  +  uMVsu  +  2e*W4Xv  +  u'*n\w  +  2u*\VeU'. 


The  relevant  observer  equations  are 

$  =  (H'-'  -  AH 5)-', 
r  =  {H'3  +  AH6$Tn*}-\ 
A  =  A  +  B2V1P  +  B2V2, 

B  =  -{U,PaU2). 

C  —  C2  +  E2V\P  +  £2^2, 

51  =  r(C  +  XW^^DB), 

52  =  -r(H2‘  +  AHe^J-tr;), 
T^  =  x^-DB  +  w;Sii 
T2  =  A$(H^;  +  W;S2). 


(10.13) 


(10.14) 


(10.15) 

(10.16) 

(10.17) 

(10.18) 

(10.19) 

(10.20) 
(10.21) 
(10.22) 
(10.23) 


Y  =  {A-  H2S1  -  H4Ti)y  +  y(i*  +  c*52  +  b*d^T2) 

+Y(C*Si  A  B*D*Tx)Y  -  (H'l  -I  H252  +  14  472),  }'(0)  =  0.  (10.24) 

Note  that  the  above  equation  is  symmetric. 
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The  suboptimal  controller  is  given  by 

<j  =  Aq  +  Bi{U\Pq  +  f/29)  +  B2{\\Pq  +  V29)  +  Pi^q  +  D2U  —  y),  (10.25) 

L  =  iSiY  +  S2)\  (10.26) 

u  =  {U\P  +  1/2)9-  (10.27) 

11.  Conclusions 

In  this  report  we  treated  the  suboptimal  finite  horizon  ifoo  control  problem.  A  differ¬ 
ential  equation  for  the  measure  of  performance  is  derived.  The  report  also  illustrates  the 
usefulness  of  the  finite  horizon  techniques  in  computing  the  infimal  Hoc  norm  in  the  infi¬ 
nite  horizon  case.  An  expression  for  a  suboptimcd  finite  horizon  H^o  controller  is  derived 
in  a  generalized  case.  The  general  case  has  been  treated  directly  without  the  utilization 
of  transformations.  The  ouput  feedback  controller  is  synthesized  via  a  controller  compo¬ 
nent  and  an  observer  component.  A  stunmary  of  all  the  design  equations  is  given  and 
these  equations  axe  easy  to  program  on  a  digital  computer.  In  the  time-invariant  case  the 
dynamic  Riccati  equations  involved  in  the  design  usually  converge  to  constant  matrices. 
The  theory  developed  in  this  report  is  useful  for  the  worst  case  design  of  flight  control 
systems  of  aircraft  in  the  presence  of  disturbances,  commands,  and  sensor  noise.  The  con¬ 
troller  equations  axe  in  a  form  that  is  convenient  for  the  design  of  flight  control  systems 
of  advanced  aircraft,  since  the  results  are  applicable  for  a  very  general  case.  Preliminary 
applications  to  flight  control  design  have  shown  considerable  promise  and  the  next  phase 
of  research  will  be  directed  towards  the  development  of  a  systematic  methodologj’  for  the 
design  of  a  flight  control  system  for  an  advanced  aircraft.  Further  research  eiIso  needs  to 
be  done  to  cissess  the  relationship  of  the  weighting  matrices  to  satisfactory  performance. 

12,  Future  Work 

Software  is  already  in  place  to  predict  the  best  aircraft  performance  under  worst  case 
conditions.  The  success  of  this  portion  of  the  software  is  demonstrated  in  Section  6  of 
this  report  by  way  of  examples.  Future  work  based  on  the  theoretical  results  of  the  report 
would  entail  the  following: 

1.  Making  use  of  the  theory  developed  in  Sections  7-9,  software  will  be  developed  to 
synthesize  both  state  axid  output  feedback  controllers. 

2.  Making  use  of  an  advanced  aircraft  model  during  landing,  flight  control  laws  will 
be  developed  to  achieve  satisfactory  performance  in  the  presence  of  distiurbances, 
commands,  and  vaxiations  of  the  model. 

3.  The  performance  of  the  aircraft  will  be  compared  with  that  achieved  through  other 
techniques  and  the  benefits,  if  any,  will  be  demonstrated. 
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